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RECURSIVE LEAST-SQUARES LATTICES 
AND TRIGONOMETRY IN THE SPHERICAL TRIANGLE 



F. Desbouvries 

Institut National dei Telecommunication^ 9 rue Charles Fourier, 91011 Evry, France 



ABSTRACT 

The 3 fundamental planar biorthogonaHzation iteps 
which underlie the geometric derivation of the FRLS adaptive 
lattices are gathered into a unit-length 3D tetrahedron. The 
inverse of Yule's PARCOR Identity (YPH) then admits a nice 
geometric interpretation in terms of projections into this 
tetrahedron. Since tetrahedrons are closely related to spherical 
triangles, YPII is recognized as the fundamental "cosine law'* 
of spherical trigonometry. In that framework, the angle- 
normalized RLS lattice recursions happen to be one particular 
solution to one of the six spherical triangle problems. The 
practical interest of this brand new geometric interpretation is 
that we can take advantage of the well-trodden path of 
spherical trigonometry to derive unoticed recursions among 
RLS quantities. This leads, for instance, to an original "dual" 
version of YPII. 

1 - INTRODUCTION 

Fast Recursive Least-Squares (FRLS) prewindowed 
(PW) algorithms are well known to exist under three different 
structures : transversal, lattice, and QRD-based filters. The 
Recursive Least-Squares Lattice (RLSL) has been known for a 
long time now (1]. Later on, Lee et al showed that the RLSL 
basic cell reduces to a recursion among 3 variables only, when 
appropriate normalization is performed. The incoming entries 
are the forward and delayed backward "double-" or "angle-" 
normalized prediction errors, and rji-'i • at order B_1 » 
together with the order PARCOR pj* 1 al time /- 1 . The 
algorithm first updates the PARCOR, then computes the 
forward and backward errors at order n (l-a»b,c) : 

Pi - KMf ♦ ('- iUZ->ffp'.- , {i- KKK'.)')* 

These recursions were derived both algebraically [2] 
and geometrically [2), 13]. However this first geometric 
derivation was rather lengthy and presented the disadvantage 
to make a clear distinction between, on the one hand, the 
order recursive equations (1-b), (1-c); and on the other band, 
the pure time-update (1-a), the derivation of which needed to 
introduce a complicated decomposition of some orthogonal 
projection in terms of oblique projections. 

Both derivations were reconciled in a most elegant 
way (4) when it appeared that (1-b). (l-c) as well as a 
reordering (1-d) of (1-a) : 



pr , -(/-?.-.«-.)TVi- ? i-«<^) r )( / -*'-'<^5) r )"* 

were 3 particular applications of a general identity among 
partial correlation coefficients, first discovered (in the scalar 
case) by Yule (5]. 

In this paper, we first gather the 3 fundamental planar 
blorthogonalization steps which underlie the RLS adaptive 
lattice In a 3D unit-length tetrahedron. YPII then receives a 
nice new geometric interpretation in terms of projections into 
this tetrahedron. 

Now, tetrahedrons and spherical triangles are closely 
related figures in the 3D space. Deriving projective identities 
into tetrahedrons thus amounts to deriving trigonometric 
relations on the sphere. It then happens that YPII is indeed 
the fundamental cosine law of spherical trigonometry. In that 
new geometrical framework, the old, classical angle- 
normalized RLS lattice algorithm happens to be one particular 
solution to one of the six spherical triangle problems. 

Furthermore, the formulae of spherical trigonometry 
induce, by analogy, similar recursions among parcors. For 
instance, the cosine law in the polar triangle leads to an 
original "dual" version of YPII. 

2 - UPDATING OF PROJECTION OPERATORS 
AND PLANAR BIORTHOGONALIZATION STEPS 

The following derivation can be formalized in any 
Hilbert space (since we are just concerned with projection 
identities), and more specifically in the space l?(Q ( A,P) of 
square-integrable random variables with inner product 
(X t Y)-E(XY T ). In this paper, we will adopt the perhaps 
more familiar alternative viewpoint of deterministic adaptive 
filtering. The framework is thus the space R N of N- 
dimensional vectors. More generally, for reasons to become 
clear soon, X (and also 1\ A, B, C) will denote in the sequel 
any arbitrary aggregate of n x (lS/i^SAO ^-dimensional 
vectors (see e.g. [3] for details); the inner product among X 
and Y is defined as (X f Y) = X T Y\ X is orthogonal to Y (Xl. Y) 

if (x,r) = o . 

The linear combination x of a set of vectors 
Y = [y\"-y ) th at Dcsl ft** (in a LS sense : |x-Jr| min) a 
vector x is well known to be the projection of x onto the 
space spanned by the vectors of Y. Thus LS filtering is 
intimately connected with projecting onto a vector space. 
Recursive LS Altering is concerned with updating the optimal 
solution on arrival of new data; it thus amounts to updating 
projection operators. Let P x = X(X T Xy x X T denote the 
projection operator onto the space spanned by X, and 
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Pj£ =/-X(X r X)" I X r iu orthogonal complement 1 . Now, a 
bey tool for updating projection operators U the fact that the 
projection onto the augmented subapace (X,?) U equal to the 
projection onto X, plui the projection onto that part of Y 
which is orthogonal to X : 

Px + Pjtr[Y T PjcY)' l Y T Pi ( 2 -») 

(2-b) 



Pit - H - Pjyjy'Pir) r T P x 



These identities are of utmost importance in RLS adaptive 
Altering as well as in Kalman filtering. 

Let us now recall some known results [6], [7]. From (2- 
b), we see that we can go from PfA to p y ^A with the help of 



P r V = I^-PtB{B T P}By l (B T P}A) 



(3-a) 



apart from the obvious orthogonality relationships : 
PyA X Y ► PyB X Y , Pf^ X Y,B 

there appears a new one among the 3 above vectors : 

P&A ± P}B O-b) 
Now, from the 2 elementary residuals p^A. PyB used 
in (3-a), we can construct as well the 2 nd augmented residual 
P/^B. Similarly, P Y X A B LP}A. This leads to fig.l : 




figure 1 - 



The coupled recursions (PfA.PyB) -» (P r \ A B. P Y \gA) are 
thus a "planar" 2 biorthogonalization process (4) : 



[P}A P}B] 



•(a^aY\a^b) 

-{tiPPr By 1 ( B?P y a) J 



1 



with 



f r V 1 P}B . P r l A B 1 PyA 



This is maybe best visualized by fig.2, drawn out of fig.l (for 
the 2 right triangles lie in parallel planes): 



1 whatever the projection operator considered. we suppose that XTX is 
[Avertible (otherwise we caa laJcc generalized Inverse* [I]) 

2 Siace Y t A and B lie in 3 disjoin* subapaccs of A* ( the null vector is 
Uie only vector eommun to toy two out of tbese three subspaccs), tbey 
are viiuaiifd by noB-coplanaj vectors la Og.1 which, necessarily, is 
dimensions]. On the other hind, both PfjA and p rjk B lie in the space 
spanned by the 2 -vectors* ?$A tad P$B (sctusity a N** A and a Nm 9 
matrix, respectively); whence the (Improper) use of the terra 
"planar". 



- figure 2 - 




HA 



It will soon be necessary to manipulate normalized 
residuals, defined as 3 : 

TJa t ppA(A T P^A)~ i (5-a> 
in which M in denotes any^quarc-root of the positive definite 
matrix M t i.e., W*(« p *) r a Af*Af*=: M . Then we have : 

(4) admits the normalized version (6-a,b) : 

o (/VP) -51 



in which p - p r (A, B) is the PARCOR (7): 

o^P^rtA^^fl)^ -p?(*A) 
and we used the identity (B) : 

(B^jB^Py^Bf « (/-Mil.AWA.*))* 
which is soon derived from (2-b). 

3 - YULE'S PARCOR ID ENTITY 
IN THE UNIT-LENGTH 3D TETRAHEDRON 

Yule's PARCOR Identity is a formula that expresses 
the augmented parcor py^C.B). say, in terms of the 
elementary ones Py(A.C), P><*A) end P>< c »*). K ia «mply 
derived by pre- (post-) multiplying (2-b) by (c r J^c)"*C r 
(by flf^P^B)'*), and by using (7), (8) (see [8], Annex A, for 
details): 

Pr^(C.st) * (!-P T (C<A)Py(A>C))~** (0) 

(p r (C B) -Py(CA)Py(A t B)) x (/-M* *)Pr(A.B))~* 
(9) admits the reordered (sometimes called "inverse**) version : 
Py(CB) - Pr(C % A)p r (A.B) + (l-p r (C.A)py{A.C)fx (W) 

Pta (C B) x (/ - p r (B t A)p r (A, B))* 

(9) and (10) are fundamental in RLS lattice filtering, 
since the angle -normalized lattice recursions (1) are nothing 
but particular applications of (9) (or (10)). More precisely, let 
{yi) be a m-dimensional process. Define the (t+l}xm matrix 
y,_ «(0"0y 0 -y,_ ] T (the p first rows are zeros), and the 
(f+f)il vector a»|0" 0l] r (the "pinning vector"). Then (1) is 

3 we assume that A T f$A is positive definite. The positive semi-definite 
case is treated in (I). 
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obtained from (9) by setting r-|^»JU,|. «« «*■ "ifjj 
(AJ.C) by the feltowing permutation, ot (y,.».-..g) 1*1. tf»l- 





P " 1 a a c: 


(1-b) 
(1-c) 
(l-d) 


y,-. * y, 
y t a y,., 
a y.-. y« 



Now, traiuionnaaoiis mhuub 

ttan.fornu.iOD. among lie filter, which produced .he.. 
Residuals. Consequently, the FRLS transver.al fitter 
eclon. are derived by «-^* ' 
applications of (6), when we "J * 

aggregate, out of die set (v,.y,...a) W. P.J* 
haSd. the FRLS argU-.orm.Uzed lattice ™ * »» 

partculnr applications of (9) or (10). obuuoed by taking to 
^product of (6-a). written for 2 partjcnlnr m«» 
Uken out of the same aet (,,.,„.*). by ** same ormul* 
written fo^notberXJiSS^t 9 ) fi^TT^ • 

&^".^tar^w«»redinl6] 

This suggest, that the geometric figure tha beat 
represents the FRLS problem, in both transversal and lattice 

rpTT p^tf) - or, more generally, (/VA,/V*.'7 C > 

o^g^In-VeneJ. one canno, vi.ua.Ue more man three 
di.joL subapace. of R». However, in viewof figj^or 
recursion. (6)). the « augmented residual. P^B, fy»A. 
^ ^ arrffetakepl.ee in the same figure 



too 3 




figure 3 - 



4 - CONNECTIONS WITH SPHERICAL 
TRIGONOMETRY 

Tetrahedron, (and thus spherical trigonometry) pUy 
tbe same fundamental role in solid geometry a. triangle, (and 
thu. cle*«lcal trigonometry) in planar geometry 110]. 
Spherical trigonometry Is a tool of outstanding importance in 
.Lnomy and navigation on .hip. or airplane, (however, 
connection, with RLS adaptive filtering had never been , made 
to far!). To see bow thing, are related, notice (see fig.4) thu 
any 3 poin» « the 3D unit sphere fctermto. : etther ^ 
length tetrahedron OABC (U, lengUKOA) - length(OB) - 
"S(OQ - 1) - and tbn. our projection (RLSL) problem: or 
tbe ^fefftal triangle ABC - and thus spherical trigonometry. 



tiguie A - 



In tbe annex, we rederivo (10) (i.e.. YPH) in terms of 
projections inside this tetrahedron. More precisely, we snow 
K "length" of 0&. where Q is 
projection of B onto A, is equal to ptf.B). » U *■ f 0 «J 
Now. * can be tot projected .on*. OA siting InH. J« 
can again be projected onto OC. which gives p. This results 
can again w f»j sr . pi fbi. decomposition 

in decomposing OQ as OP + PQ ■ *~ 

corresponds exactly tojbe two-terms sum of the * 0£ 
i e thV length OP of O? is equal to p r (C.A)p r (A t B). while 
.be 2"«< term of the r.b.s. of (10) is equal to the length of PQ . 

in th. lotlowiag. lor . point o. *. «!*« •» «" •» *» " 

5 "^ t oroan.ui.^.».w.i««^--«««'' i '-' , " ,,, ' ho " 
« vwton (U»» ottuallr l«S» o««). 




By definition, the spherical triangle ABC consist, of 
the 3 arc. AB.AC and BC of "great circle." obtained by 
mLnecting the 3 plane. OAB. OAC, OBC (l.«.. winch pas. 
«he center O of the aphere) and the sphere. The an* 
U equ* to the length of arc BC and is denoted by £ We 
cU A the dihedral angle between planes OAB and OAC. 
defined a. .he plane angle between 2 straight ^ 
to OA. and belonging respectively to OAB and OAC. Note 
that A is equal to the plane angle formed by tangent, to the 
,ide of the angle at vertex A. and similarly for the renummg 

" gl " There are 3 degrees of freedom in a spherical triangle : 
any 3 angle, (out of 6) perfectly determine the 3 remaining 
one.. Con.eq»ently. there cannot be more than 3 distinct 
relationship, among th. 6 angles. To get one such set. let us 
now revisit tbe derivation of (10) as given m the annex 
(which actually was inspired by (11]). but now considenng 
fig.4 as well as fig.3. Oe=c»«. OP=«»b eo.c. and 

just derived the fundamental -law of cosines- of spheneal 
.rigonomeay : = + 

which thu. happen, to be equal to the YPD (in the scalar case). 

through the identification 6 (12) : 

cose o PriC.B) «* A " ^ C - m 
co, j, v p r (CA) OTfl ° *» {C ' A) 
coae „ p r (A,F) «sC « Plr*W.*> 



6 VV^J. 4c 



.ponl aonn of P,(A.81 lata* M- 
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since (11-a) remains valid under permutation of the variables, 
we get 7 : 

cos b = cos a cose + sin a cos £ tin c (H*b) 
cose * co« a co* b + sin a cos C sin b (U-c) 
In that framework, the angle-normalized RLSL is one 
particular solution to one of the six M spherical triangle 
problems" (i.e., determining any 3 angles from the 3 other 
angles) [12], [13] : "given 2 arcs b and c, plus an angle in- 
between A, find the third arc a and the two remaining dihedral 
angles B and C. To see this, set as above v = [y,.| —y,>.*i ]» 
and {AM>C) = (0.y,_.,y,) . At time #-1, we know toe angles i, 
c and A (actually their cosines) : 

cos £ - £' M _i . cosc=ni-i • eos A ° pi" 1 
We Hrst compute cos a » pj through (11-a) » (1-a), then 
cos B = ei and cos C = ft via (ll-b) = (l-b) and (U-c) = 
(1-c). respectively. 

A "dual" version of YPU 

Now, the formulae of spherical trigonometry [10-13] 
induce, by analogy, similar formulae* among parcors. For 
instance, consider the 2 great circles having as poles B and C. 
They intersect in 2 points A ' and A M . Let A' be the point on 
the same side as A (and similarly for B' and C). We just 
defined the so-called "polar triangle" A'B'C* of ABC. In this 
triangle, the angles <T and A' are equal to fl-A and R-a, 
respectively (and similarly for the other angles); the cosine 
law reads : 

cos As- cos B cos C + sin B cos a sin C (12) 
This suggests the following formula among parcors (13): 
p rM (C.fl) = -p r , a (C.A)p r . c (A.B)+(/-p r ^(C,A)p rtB (A,C)^x 

Pr (C. fl)x (/ - Py tC (B*A)f>y tC {A t B)) j 

indeed, (13) does hold for scalar parcors (A, B and C are Mi). 
It is derived by considering once again the proof gi v en in th e 
annex, b ut now in the -polar tetrahedron" P tt t tC A, T^fi* 
P y Xj£> Notice that : 

[Kl^^i^) - ('-Pw(^ APr.A( AO)'* x 

(-Pm<C. *)) (/-P M (* QPtjS£* *>)* 
which reduces to -p y>A (C,2?) in the scalar case, whence (13). 
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ANNEX 

Let H be the orthogonal projection of B onto dk. 
With the help of fig.2, OB = OH + HB reads (Al) : 

Let us project this decomposition ofa ~ otl + onto 
the third vector OC of the tetrahedron: 

Vc^'Vct^^))*^!^^) (A2) 

Now, we would like to express the fact that the 
relationship (A2) among vectors remains valid when 
considering their length, since OP, OQ and PQ are colinear : 
OQ -OP + PQ (the sum is algebraic). To that end. let us pre- 
multiply (A2) by fJfcf • Weget(A3-a) : 

R r {(^)=(^)F) r (^) + ^R} 

Introducing the parcon vi» (7), (A3-*) become* (A3-b) : 

p,(C.fl)=p r (C.A)p r (/t,*)+(i?c) r j^r ; (j?i) 

To get further, let us consider the orthogonal 
decomposition ot * 0$+ 7b. The second term of the r.b.s. of 
(A3-b) can be rewritten as (A4) : 

(C T P}C)-*[CW.* ♦ C r P r ^A(A r P^)" 1 A r ^]i^(rVi) 



Since 1 o), the second term in the above inner-product 
is zero. Thus (A4) reduces to (A5) : 

(C T Pfc)~* C T P r l A x P Y l A B(B T PiBy* 
where we used fig. 2. Using (8), (A5) is rewritten as (A6): 
(/-p r (C.A)p r (A,C))+p y , 4 (C,B)(/-/> y (a.A)p r (A l B))* 
Gathering (A3-b) and (A6) results in (10). 



111-407 



http://ieeexpioreieee.orgte^ 

Copyright © 2002 IEEE — All rights reserved 



2/19/02 4:52 PM 



IEEE Xplore Search Results 

1E£E HOME 1 SEARCH IEEE « SHOP 



http://ieeexplore.ieee 
, WEB ACCOUNT 1 CONTACT JEEE 



. org /search97/s97i...&queryText=nonnal E at 1 on + and +g nd + pou.t S 




O Horns 
O-108-wA 



your search matched 4 of ^^Z^WcaXlot, year in descending order. 

rr^— ^ search expression or enterin9 3 new 

TTiencJickS^ 




Cy Conference 
O Standards 



Results: iMi conference = CNF Standard = STD 

journal or Magazine = JNI^o^ 



O Basic 
Qr Advanced 



@Pr%it Format 



; FUI „^^ samp,in9 and sin9U,ar ,a,ue 

decomposition 

Yeung Yam IEEE Trans actions on , Volume: 27 Iss 

Systems, Man and Cybernetics, Part B, IEtt 

Dec. 1997 
Page(s): 933 -951 



Bbstractl im^^^^^ 



I Singu.ar va.ue-based identification of fuzzy system 

SonTnd Contro,, 1997., Proceedings of the 36t h IEEE Conference on , Vo 
Page(s): 3341 -3346 vol.4 



lAbstractl IS^iJ^^^^ 



3 a comparison of rotation-^ed methods for iterative reconstruction 
algorithms sdiafe r, R.W. 

S^MSSE ■ — • — 6 Part; 2 ' ° ec - 19 

Page(s): 3370 -3376 

7^^^^ « reC ° nS,rUCt,0n 



2/19/02 6:10 PM 



lof2 



IEEE Xplore Search Results 



http:/Aieeexplorejeee.org/search97/^ 



Di Bella, E.V.R.; Barclay, A.B.; Eisner, R.L; Schafer, R.W. 

Nuclear Science Symposium and Medical Imaging Conference Record, 1995., 

, Volume: 2 , 1995 

Page(s): 1146 -1150 vol.2 



[Abstract! [PDF Full-Tex t f528 KB)1 CNF 



tfrnr | I jg. !T ri. | r.nnfpr ence Proceedings I Standards | Search by Author I iasicSearch | Advancec 'Search 

joSIe l^cS^febi^inoPA^nq information | Your FmlharK I T^^'r^Supporjl Erna.l Alertmq 
n^obo^PleiieTr^i^Notes I 1PFF Online Publications I Help I FAOJ Terms I BacktoTop, 



Copyright © 2002 IEEE — All rights reserved 



2 of 2 



2/19/02 6:10 PM 



IEEE Xplore Search Results 



htt P y/ieeexplo~re.ieee.org/s^ 



IEEE HOME 



I SEARCH IEEE \ $H05> ! WEB ACCOUNT I CONTACT IEEE 



Membership P 8 bHcatl«ftS/S*rvte« Standards Conf_«.«c« Career'/Jobs 





Q- Logout 



f> Journals 
A- Conference 
O Standards 



0- 8y Atithor 
0~ Basic 
(y Advanced 



g&Pmt Format 



Yo U nay refine your search b, editing the current search expression or entenno a new one the te 



Then click Search Again. 



normalization and linear interpolation 



SearchAg^ 



^umaUr Magazine = JNL Conference = CNF Standard = STD 



i Feature windowing-based Thai text-dependent speaker identif.catio 
MLP with backpropagation algorithm 

SSSp^*. ™° 2000 IEK 

International Symposium on , Volume: 3 , 2000 

Page(s): 579 -582 vol.3 



[Abstract! \°™ P»»-T«*t r352 KB)1 CNF 



2 Evaluation of polynomial image deformation using anatomical landm 
matching of 3D-abdominal MR-images and for atlas construction 

Kimiaei, S.; Noz, M.; Jonsson, E; Crafoord 1; Maguire, G.Q Jr. 

Nuclear Science, IEEE Transactions on , Volume: 46 Issue: 4 Part. 2 , Aug. 19 

Page(s): 1110 -1113 



[Abstract! [dhf F„ll-Tpyt (288 KB)1 JNL 



3 Nonlinear shape normalization methods for gray-scale handwritten 
recognition 

1997., Proceedings o. the Fourth Interna 

Conference on , Volume: 2 , 1997 
Page(s): 479 -482 vol.2 



[Abstract! \°™ F..H-T P yt (372 KB)1 CNF 



4 A comparison of rotation-based methods for iterative reconstruction 
algorithms 



2/19/02 6:12 PM 



1 of 2 



http: //i e eexploreieee.org/seareh^ 

IEEE Xplore Search Results 



Di Bella, E.V.R.; Barclay, A.B.; Eisner, R.L.; Schafer, R.W. 

Nuclear Science, IEEE Transactions on , Volume: 43 Issue: 6 Part: 2 , Dec. 19 

Page(s): 3370 -3376 

[Abstract! [ pnF PmII-W C148 KB)1 JNL 



5 Comparison of rotation-based methods for iterative reconstruction 
algorithms 

Di Bella, E.V.R.; Barclay, A.B.; Eisner, R.L; Schafer, R. W. 

Nuclear Science Symposium and Medical Imaging Conference Record, 1995., 

, Volume: 2 , 1995 

Page(s): 1146 -1150 vol.2 

[Abstract! [PHF Full-Text T528 KB)1 CNF 



6 Multiscale image texture analysis in wavelet spaces 

Gross, M.H.; Koch, R.; Lippert, L; Dreger, A. 

Image Processing, 1994. Proceedings. ICIP-94., IEEE Internat.onal Conferenc 
Volume: 3 , 1994 
Page(s): 412 -416 vol.3 

[Abstract! [dhf F..n-T«rt T488 KB^l CNF 



Copyright © 2002 IEEE — All rights reserved 



2 of 2 



2/19/02 6:12 PM 

f 



